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BACKGROUND OF THE INVENTION 

Related Application 

This application is a continuation-in-part of U.S. Patent Application Serial No. 
09/426,102, entitled "Method and Apparatus for Content Personalization Over a Telephone 
Interface" filed on October 22, 1999. 
Field of the Invention 

This invention relates to the field of personalized electronic phonebooks. In 
particular, the invention relates to technologies for accessing and updating an electronic 
phonebook over electronic communications networks such as a telephone and computer 
networks. 

Description of the Related Art 

The following describes various techniques used in telephone systems to provide 
enhanced user features. First, telephone identifying information will be discussed. Many 
telephone systems that support enhanced user features use telephone identifying information 
as a basic component. Then, a variety of example systems will be discussed that use telephone 
identifying information to provide enhanced user features will be discussed. 

1 . Telephone Identifying Information 

The advent of automatic number identification (ANI) and calling number 
identification (CNID, CLID, or CID) within the North American Numbering Plan (NANP) 
has supported the creation of a number of services that use these pieces of telephone 
identifying information. Comparable systems may be used in other numbering plans and 
countries to support similar services. 
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For example, when consumers receive credit cards in the mail, they have to call from 
their home telephone numbers to activate the cards. This is a typical use of ANI. In this 
instance, the credit card company matches the ANI information provided when the consumer 
calls to a previously provided telephone number. If the ANI matches the credit card 
5 company's records, the credit card company activates the card. 

2, Examples of Telephone System Personalization 

a. Personalization Generally 

With the advent of widely available real-time delivery of telephone identifying 
y information such as ANI, a number of systems have been developed to use that information. 

j: 

Zi 10. One of the most common uses of ANI is for credit card activation. However, previous systems 

•■Pa 

iJj have been single purpose and typically require reference to other information provided 

in 

IB separately. For example, credit card activation lines require separately provided information, 

M e.g. your home phone number from the application. 

b. Building Personalized Content on the Web 

^ 15 Some systems allow a user to build personalized content over the web. One example is 

the myYahoo!™ service provided by Yahoo! of Santa Clara, California at 
<http://my.yahoo.com/>. The personalized content pages developed on the web are delivered 
over the web to users accessing the pages with computers. These systems rely on a username 
and password type system to identify the user rather than telephone identifying information 
20 and the delivery mechanisms is different. 
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c. Interactive Personalization 

Still other systems allow users to personalize the content without entering special 
editing modes. For example, Amazon.com, of Seattle, Washington, keeps track of your 
purchases and preferences using cookies stored on a customer's web browser. 

Some telephone systems provide limited customization capabilities. For example, 
voice mail systems from Octel, a division of Lucent Technologies, allow a user to set 
preferences for prompt length, but those settings must be made explicitly by each user. 
Further, customization is limited to a few options like prompt length and outgoing message 
selection. The user can not redefine the way the voice mail system works for her/him beyond 
those narrow customization options. Further, these customizations do not affect the kinds of 
content and further the presentation is not selected based on telephone identifying 
information. 

d. Locale Selection 

Services such as Amtrak ! s 1-800-USA-RAIL reservation line use telephone 
identifying information to select an initial region. For example, if you call Amtrak ! s 
reservation number in the Northeastern United States, the system presents options relating to 
the Boston- Washington line. However, if you call from California, the system presents 
information about travel between San Francisco and Los Angeles. 

This can be accomplished by using the calling party's area code and/or exchange 
included with the telephone identifying information to select a region. The area codes and/or 
exchanges can then be paired to different scripts or default selections. For example, the area 
codes for New York City, e.g. "212", could be mapped to the Northeast Corridor while San 
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Francisco, "415", could be mapped to the San Francisco-Los Angeles line. However this does 
not change the kind of content presented and it is not user-selected. 

e. Time Appropriate Information Presentation 

Several services provide information through the telephone. That information may be 
adapted based on the time of day or date. 

Some systems provide the information irrespective of the telephone identifying 
information. One example is Moviefone™, 777-FILM in most locales. Moviefone™ uses the 
current time at the called number to present appropriate information. The called number can 
be obtained using the dialed number identification service (DNIS). Thus, if you call 
Moviefone™ in the San Francisco Bay Area at 10 o'clock in the morning, only movies 
starting after 10 o'clock in the morning in the San Francisco Bay Area will be presented to 
you. However, if you call the Philadelphia Moviefone™, +1 (215) 222-FILM, from 
California, you will hear the Philadelphia movie times in Eastern Time. Thus, at 10 o'clock in 
the morning Pacific Time, a call to the Philadelphia Moviefone™ will produce information 
for Philadelphia show times after one o'clock in the afternoon Eastern Time at Philadelphia 
area theatres. 

f. Targeted Advertising 

Some free long distance services provide customized advertising to support their 
services. One example is FreeWay™ offered by Broadpoint, of Landover, Maryland, 
<http://www.broadpoint.com/>. These services require an explicit user registration process, 
typically using a computer to access a web site, to provide the service with a profile. Once the 
profile is provided, the advertising is targeted to the particular person's explicitly provided 
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demographic information. In some instances, the advertising may be targeted both based on 
the caller's demographics and their location. Thus, callers from the San Francisco Bay Area 
with a particular explicit demographic profile may be presented one ad, while callers from 
outside the San Francisco Bay Area maybe presented with another ad. Another, similar, 
service is offered on by phone by UAccess, Inc., <http://www.uaccess.com/>, by calling +1 
(800) UACCESS, and provides consumers targeted advertising based on profile information 
they enter. 

g. Voice Character 

Most telephone systems have a small number of voice actors. Continuing with the 
example of Moviefone™, one actor performs all of the menus and prompts. Other systems 
may use different voice actors for different subsystems. 

These actors are typically selected on a system wide basis and as such, different 
voices, talents, speeds, characteristics, dialects, and other prosody aspects of the presentation 
are not user selectable. 

h. Purchase Recommendations 

Voice systems such as GALAXY from the Massachusetts Institute of Technology 
(MIT), Cambridge, Massachusetts, have been adapted to provide information about 
purchasing decisions for used cars. For example, GALAXY has been used to allow for 
interactive browsing of automobile classified ads. These voice systems are problem domain 
specific. Further, the systems are designed to locate vehicles matching a particular set of 
criterion, rather than making actual recommendations. 
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Other systems are web based. For example, Amazon.com will make book suggestions 
for users connected to the web via a computer. However, those suggestions are limited to a 
particular site, e.g. Amazon.com. 

i. Voice Login 

Most telephone systems require a user to explicitly identify herself/himself by using a 
combination of a login identifier, e.g. credit card number, account number, etc., and a 
personal identification number (PIN). Some systems abbreviate this process by allowing a 
user calling from a particular phone to shortcut this process slightly. For example, callers 
using a phone number associated with a particular credit card might only be asked to enter the 
last four digits of their credit card number together with their billing zip code instead of all 
sixteen digits of the card number. Other products such as Nuance Verfier™ from Nuance 
Communications, Menlo Park, California, support voice login capabilities, e.g. you just speak 
instead of entering a password. 

j. Initial Profile Generation from Database Lookups 
Most systems that provide information over the telephone require users to explicitly 
answer one or more questions in one form or another, e.g. over the phone, the web, and/or in 
written form. These questions form a demographic and/or psychographic profile for the user. 
All of these systems require the user to explicitly provide her/his profile information. 

SUMMARY OF THE INVENTION 

A method and apparatus for updating an electronic phonebook over electronic 
communications networks is described. The voice portal uses telephone identifying 
information to select, or create, a user profile to associate with a particular piece of the 
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telephone identifying information. The user profile includes or contains a pointer to the user's 
electronic phonebook, and in the latter case, the phonebook is still effectively a part of the 
user profile. 

The phonebook can be intelligently updated by the voice portal, at the user's option, 
5 when the user specifies a number that does not correspond to an existing phonebook entry. 
Additionally, the user can use an email or button on a website to permit others to add the 
user's contact information to their phonebooks using only a single mouse click. 

The personalized content presented during a telephone call is specific to that user 
based on the profile associated with her/his telephone identifying information. For example, if 
^9 10 a user, John, has previously called from the telephone number 650-493-####, he may have 
J indicated he prefers a Southern dialect. Then, upon subsequent calls to the system from his 
^ telephone John will be greeted in a Southern dialect based on the profile associated with his 

~ number. 

| ft Example personalizations provided by embodiments of the invention will now be 

IP 1 5 described. The system may personalize the session based on the time and/or date as 

determined from the telephone identifying information. For example, based on the local time 
for the calling party, time and/or date appropriate options may be presented. For example, if a 
user calls from California at noon, a restaurant for lunch may be suggested. However, a caller 
from London at that same moment might be presented evening entertainment selections 
20 because of the eight hour time difference. 

The system may personalize the session based on the caller's locale as determined 
from the telephone identifying information. For example, caller's from Palo Alto, California 
may hear different selections and options than callers from Washington, D.C. This may 
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include locale specific events, e.g. a county fair, locale specific announcements, e.g. flood 
watch for Santa Clara County, etc. 

The system may target advertising based on the caller's demographic and/or 
psychographic profile. Additionally, the advertising may be targeted based on the telephone 
5 identifying information. For example, overall demographic information for a particular area 
code-exchange combination may be used, e.g. 650-493 corresponds to Palo Alto, California, 
with an average income of $X. On an international scale, this can be used to the extent that 
the particular numbering plan can be combined with relevant 

geographic/demographic/psychographic information about callers. Both types of targeted 
yj 10 advertising allow the callers to be qualified, e.g. match the requirements of the advertiser. For 
^ example, a San Francisco jewelry store might only want to reach households in the Bay Area 
2 with an average household income exceeding $50,000 a year. The targeted advertising can 
f s " ensure that callers presented with the ad are qualified. 

p J The system may adapt the voice character, e.g. the speech patterns and dialect, of the 

13 1 5 system according to the caller's telephone identifying information and/or the caller's own 

voice character. Thus, for example, for callers who speak more slowly the system may reduce 
the speed at which the system speaks and/or increase the volume. This may be based on the 
telephone identifying information, e.g. hospital, an explicit request by the user, e.g. "Slow 
down", and/or implicitly based on the caller's speech patterns and interactions with the 
20 system. 

Based on the caller's profile - as retrieved through the telephone identifying 
information — and/or demographic information from other sources, e.g. locale based and/or 
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reverse phone directory lookup, the system can make purchasing suggestions. For example, 
close to a holiday like Mother's day, the system may suggest a gift based on what other people 
in that locale, e.g. Palo Alto, are buying and or based on the user's own purchasing history, 
e.g. she/he bought flowers last year. Similarly, the voice portal can recommend the purchase 
of an audio CD based on previous audio CD purchases. 

The system may use a voice password and/or touch-tone login system when 
appropriate to distinguish the caller or verify the caller's identity for specific activities. 

These customizations may be combined in a variety of fashions. Thus, for example, 
the time, the locale, and a preferred dialect may be used to present a purchase 
recommendation. 

Profiles can be constructed implicitly as the caller uses embodiments of the invention 
as well as through explicit designation of preferences. For example, the user might specify an 
existing personalized web site to use in building her/his profile for the voice system. 
Similarly, for a caller from New York who repeatedly asks for the weather in San Francisco, 
the system might automatically include the San Francisco weather in the standard weather 
report without explicit specification, or confirmation. 

Additionally, new callers may have an initial profile generated based on one or more 
database lookups for demographic information based on their telephone identifying 
information. 
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BRIEF DESCRIPTION OF THE FIGURES 

Fig. 1 illustrates a system including embodiments of the invention used to provide 
personalized content to users of telephones according to telephone identifying information. 

Fig. 2 illustrates the components of a voice portal supporting personalized content. 

Fig. 3 is a process flow diagram supporting personalization and registration of and for 
users accessing a voice portal over a telephone interface. 

Fig. 4 is a process flow diagram for personalizing a voice portal over a web based 
interface. 

Fig. 5 is a process flow diagram for providing personalized content according to some 
embodiments of the invention. 
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DETAILED DESCRIPTION 

A. Introduction 

A voice portal for presenting personalized content over a telephone interface is 
described. The voice portal allows users of telephones, including cellular telephones, to access 
a voice portal by dialing a phone number to listen to personalized content. The information 
provided over the voice portal may come from the World Wide Web (WWW), databases, 
third parties, and/or other sources. In addition, the voice portal allows a user to maintain an 
electronic phonebook and to perform various telephony functions such as voice messaging, 
conferencing, and call forwarding. 

The term voice portal refers to the capability of various embodiments of the invention 
to provide customized voice and/or audio content services to a caller. The voice portal can 
receive dual-tone multi-frequency (DTMF or touch-tone) commands as well as spoken 
commands to further control the voice and/or audio content presented and the manner of 
presentation. 

Embodiments of the invention use telephone identifying information to personalize 
caller interactions with the voice portal This allows the system to present highly customized 
information to each caller based on a personal profile the system associates with the telephone 
identifying information. 

The invention will be described in greater detail as follows. First, a number of 
definitions useful to understanding the invention are presented. Then, the hardware and 
software architecture is presented in the System Overview. Then, a series of sections describe 
the various personalization features provided by different embodiments of the invention. 
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B. Definitions 

L Telephone Identifying Information 

For the purposes of this application, the term telephone identifying information will be 
used to refer to ANI information, CID information, and/or some other technique for 
automatically identifying the source of a call and/or other call setup information. For example, 
ANI information typically includes a dialed number identification service (DNIS). Similarly, 
CID information may include text data including the subscriber's name and/or address, e.g. 
"Jane Doe". Other examples of telephone identifying information might include the type of 
calling phone, e.g. cellular, pay phone, and/or hospital phone. 

Additionally, the telephone identifying information may include wireless carrier 
specific identifying information, e.g. location of wireless phone now, etc. Also, signaling 
system seven (SS7) information may be included in the telephone identifying information. 

2. User Profile 

A user profile is a collection of information about a particular user. The user profile 
typically includes collections of different information as shown and described more fully in 
connection with Figure 3. Notably, the user profile contains a combination of explicitly made 
selections and implicitly made selections. 

Explicitly made selections in the user profile stem from requests by the user to the 
system. For example, the user might add business news to the main topic list. Typically, 
explicit selections come in the form of a voice, or touch-tone command, to save a particular 
location, e.g. "Remember this", "Bookmark it", "shortcut this", pound (#) key touch-tone, etc., 
or through adjustments to the user profile made through the web interface using a computer. 
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In contrast, implicit selections come about through the conduct and behavior of the 
user. For example, if the user repeatedly asks for the weather in Palo Alto, California, the 
system may automatically provide the Palo Alto weather report without further prompting. In 
other embodiments, the user maybe prompted to confirm the system's implicit choice, e.g. the 
system might prompt the user "Would you like me to include Palo Alto in the standard 
weather report from now on?" 

Additionally, the system may allow the user to customize the system to meet her/his 
needs better. For example, the user may be allowed to control the verbosity of prompts, the 
dialect used, and/or other settings for the system. These customizations can be made either 
explicitly or implicitly. For example if the user is providing commands before most prompts 
are finished, the system could recognize that a less verbose set of prompts is needed and 
implicitly set the user's prompting preference to briefer prompts. 

3. Topics and Content 

A topic is any collection of similar content. Topics may be arranged hierarchically as 
well. For example, a topic might be business news, while subtopics might include stock 
quotes, market report, and analyst reports. Within a topic different types of content are 
available. For example, in the stock quotes subtopic, the content might include stock quotes. 
The distinction between topics and the content within the topics is primarily one of degree in 
that each topic, or subtopic, will usually contain several pieces of content. 

4. Qualified 

The term qualified as it is used in this application refers to whether or not a particular 
user being presented an advertisement, or other material, meets the demographic and/or 



C \Usr\Patents\TMOO-002US\TMOO-002US spec DOC 



14 



Attorney Docket Number TMO0-002US 



psychographic profile requirements for that advertisement, or content. For example, a San 
Francisco-based bookstore might request that all listeners to its advertisement be located in a 
particular part of the San Francisco Bay Area. Thus, a user of the system would be qualified if 
she lived in the designated part of the San Francisco Bay Area. 

Different embodiments of the invention may qualify users of the system according to 
different requirements. For example, in some instances advertising, or content, is qualified 
solely based on telephone identifying information. In other embodiments the telephone 
identifying information is used in conjunction with other information such as an associated 
user profile, a reverse telephone number lookup for locale demographics, and/or other 
information. 

5. Locale 

As used in this application, the term locale refers to any geographic area. The 
geographic area may be a neighborhood, a city, a county, a metropolitan region, a state, a 
country, a continent, a group of countries, and/or some other collection of one or more 
geographic areas, e.g. all United State major metropolitan areas. 

For this reason, a single user of the system maybe considered to be in several locales. 
For example, a caller from Palo Alto, California, might be in the Palo Alto locale, a Silicon 
Valley locale, a San Francisco Bay Area locale, a Northern California locale, a California 
state locale, and a United States locale. 

Thus, the telephone identifying information for a single telephone number can be 
mapped to a number of system-defined locales. 
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6. Voice Character 

The term voice character as it is used in this application refers to all aspects of speech 
pronunciation including dialect, speed, volume, gender of speaker, pitch, language, voice 
talent used, actor, characteristics of speech, and/or other prosody values. Users can adjust the 
voice character of the system by changing their voice character settings. 

For example, an elderly user could select voice character settings that provide louder 
volume and slower speech. Similarly, a caller from the South could adjust the voice character 
settings to support a Southern dialect. 

7. Demographic and Psychographic Profiles 

Both demographic profiles and psychographic profiles contain information relating to 
a user. Demographic profiles typically include factual information, e.g. age, gender, marital 
status, income, etc. Psychographic profiles typically include information about behaviors, e.g. 
fun loving, analytical, compassionate, fast reader, slow reader, etc. As used in this application, 
the term demographic profile will be used to refer to both demographic and psychographic 
profiles. 

C. System Overview 

First, the hardware and software architecture of a system including an embodiment of 
the invention will be described with reference to Figures 1-2. Figure 1 illustrates a system 
including embodiments of the invention used to provide personalized content to users of 
telephones according to telephone identifying information. The system of Figure 1 can be 
used to allow users of standard telephones and cellular telephones to access a voice portal 
with personalized content from their telephones. 
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The following lists the elements of Figure 1 and describes their interconnections. 
Figure 1 includes a telephone 100, a cellular telephone 101, a computer 102, a telephone 
network 104, an Internet 106, a telephone gateway 107, a web server 108, a voice portal 1 10, 
a shared database 112 and a personalized site 130. The cellular telephone 101 and the 
telephone 100 are coupled in communication with the telephone network 104. The telephone 
network 104 is coupled in communication with the telephone gateway 107. The telephone 
gateway 107 is coupled in communication with the voice portal 110. The computer 102 is 
coupled in communication with the Internet 106. The Internet 106 is coupled in 
communication with the web server 108. The voice portal 1 10 and the web server 108 are 
coupled in communication with the shared database 1 12. The personalized site 130 is coupled 
in communication with the Internet 106. 

The following describes each of the elements of Figure 1 in greater detail. The use of 
each of the elements will be described further in conjunction with the sections describing the 
personalization features. 

The telephone 100 and the cellular telephone 101 are two different telephone 
interfaces to the voice portal 1 10. The telephone 100 and the cellular telephone 101 may be 
any sort of telephone and/or cellular telephone. For example the telephone 100 or the cellular 
telephone 101 maybe a land line phone, a PBX telephone, a satellite phone, a wireless 
telephone, and/or any other type of communication device capable of providing voice 
communication and/or touch-tone signals over the telephone network 104. However, any 
audio signal carrying interface could be used. 

The telephone network 104 may be the public switched telephone network (PSTN) 
and/or some other type of telephone network. For example, some embodiments of the 
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invention may allow users with a voice over Internet Protocol (IP) phone to access the voice 
portal 110. The telephone network 104 is coupled to the telephone gateway 107 that allows 
the voice communications and/or touch-tone signals from the telephone network 104 to reach 
the voice portal 1 10 in usable form. Similarly, the telephone gateway 107 allows audio signals 
5 generated by the voice portal 1 1 0 to be sent over the telephone network 1 04 to respective 
telephones, e.g. the telephone 100. The telephone network 104 generally represents an audio 
signal carrying network. 

The computer 102 is a computer such as a personal computer, a thin client computer, a 
server computer, a handheld computer, a set top box computer, and/or some other type of 
*0 1Q visual web browsing device. The computer 1 02 is coupled in communication with the Internet 
v f 106, e.g. by a dial-up connection, a digital subscriber loop (DSL), a cable modem, and/or 

£ some other type of connection. This allows the computer 102 to communicate with the web 

'** server 108. The computer 102 typically provides a visual interface to the WWW and the web 

5 server 108 using web browsing software such as Internet Explorer™ from Microsoft 
|p 15 Corporation, Redmond, Washington. 

O Both the web server 108 and the voice portal 1 10 are capable of communicating with 

the shared database 1 12 to register users, build personal profiles implicitly and/or explicitly as 
will be described more fully below. The database 112 stores profiles for each user based on an 
association between one or more pieces of telephone identifying information and a particular 
20 user. Thus, the database may have a profile for a user Sarah Smith that is keyed to her home 
telephone number, e.g. 650-493-####. Additionally, Sarah could associate other numbers, e.g. 
work, cellular, etc., with her profile either implicitly, e.g. by repeatedly calling the voice 
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portal 1 10 from those numbers, or explicitly, e.g. by adding those numbers to the system 
directly. 

In some embodiments, an existing profile for a web-based portal is adapted for use by 
the voice portal 1 10 by associating one or more telephone numbers with the existing profile as 
stored in the shared database 1 12. In these embodiments, the existing profile may be further 
modified for use with the voice portal 1 10 to allow for different preferences between the web 
and the voice interfaces. 

The call flow arrows 1 14-122 shown on Figure 1 will be described in greater detail 

below. 

Figure 2 illustrates the components of a voice portal supporting personalized content. 
This could be used to support the voice portal 110 and provide personal content as described 
above. 

The following lists the elements of Figure 2 and describes their interconnections. The 
voice portal 1 10 is coupled in communication with the telephone gateway 107. The voice 
portal 110 includes a call manager 200, an execution engine 202, a data connectivity engine 
220, an evaluation engine 222 and a streaming engine 224. Additionally Figure 2 includes 
elements that may be included in the voice portal 1 10, or which may be separate from, but 
coupled to, the voice portal 110. Thus Figure 2 also includes a recognition server 210, a text 
to speech server 214, an audio repository 212, the shared database 1 12, a database 226, the 
Internet 106, a database 228 and a web site 230. The call manager 200 within the voice portal 
1 10 is coupled to the execution engine 202. The execution engine 202 is coupled to the 
recognition server 210, the text to speech server 214, the audio repository 212, data 
connectivity engine 220, the evaluation engine 222 and the streaming engine 224. The data 
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connectivity engine 220 is coupled in communication with the shared database 1 12, the 
database 226 and the Internet 106. The Internet 106 is coupled in communication with 
database 228 and the web site 230. 

The following describes each of the elements of Figure 2 in greater detail. The use of 
each of the elements will be described further in conjunction with the sections describing the 
personalization features. 

Typically, the voice portal 1 10 is implemented using one or more computers. The 
computers maybe server computers such as UNIX workstations, personal computers and/or 
some other type of computers. Each of the components of the voice portal 1 10 may be 
implemented on a single computer, multiple computers and/or in a distributed fashion. Thus, 
each of the components of the voice portal 1 10 is a functional unit that may be divided over 
multiple computers and/or multiple processors. The voice portal 1 10 represents an example of 
a telephone interface subsystem. Different components may be included in a telephone 
interface subsystem. For example, a telephone interface subsystem may include one or more 
of the following components: the call manager 200, the execution engine, the data 
connectivity 220, the evaluation engine 222, the streaming subsystem 224, the audio 
repository 212, the text to speech 214 and/or the recognition engine 210. 

The call manager 200 is responsible for scheduling call and process flow among the 
various components of the voice portal 1 10. The call manager 200 sequences access to the 
execution engine 202. Similarly, the execution engine 202 handles access to the recognition 
server 210, the text to speech server 214, the audio repository 212, the data connectivity 
engine 220, the evaluation engine 222 and the streaming engine 224. 
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The recognition server 210 supports voice, or speech, recognition. The recognition 
server 210 may use Nuance 6™ recognition software from Nuance Communications, Menlo 
Park, California, and/or some other speech recognition product. The execution engine 202 
provides necessary grammars to the recognition server 210 to assist in the recognition 
process. The results from the recognition server 210 can then be used by the execution engine 
202 to further direct the call session. Additionally, the recognition server 1 10 may support 
voice login using products such as Nuance Verifier™ and/or other voice login and 
verification products. 

The text to speech server 214 supports the conversion of text to synthesized speech for 
transmission over the telephone gateway 107. For example, the execution engine 202 could 
request that the phrase, "The temperature in Palo Alto, California, is currently 58 degrees and 
rising" be spoken to a caller. That phrase would be translated to speech by the text to speech 
server 214 for playback over the telephone network on the telephone (e.g. the telephone 100). 
Additionally the text to speech server 214 may respond using a selected dialect and/or other 
voice character settings appropriate for the caller. 

The audio repository 212 may include recorded sounds and/or voices. In some 
embodiments the audio repository 212 is coupled to one of the databases (e.g. the database 
226, the database 228 and/or the shared database 112) for storage of audio files. Typically, the 
audio repository server 212 responds to requests from the execution engine 202 to play a 
specific sound or recording. 

For example, the audio repository 212 may contain a standard voice greeting for 
callers to the voice portal 1 10, in which case the execution engine 202 could request 
play-back of that particular sound file. The selected sound file would then be delivered by the 
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audio repository 212 through the call manager 200 and across the telephone gateway 107 to 
the caller on the telephone, e.g. the telephone 100. Additionally, the telephone gateway 107 
may include digital signal processors (DSPs) that support the generation of sounds and/or 
audio mixing. 

The execution engine 202 supports the execution of multiple threads with each thread 
operating one or more applications for a particular call to the voice portal 110. Thus, for 
example, if the user has called in to the voice portal 1 10, a thread may be started to provide 
her/him a voice interface to the system and for accessing other options. 

In some embodiments of the invention an extensible markup language (XML)-style 
language is used to program applications. Each application is then written in the XML-style 
language and executed in a thread on the execution engine 202. In some embodiments, an 
XML-style language such as VoiceXML from the VoiceXML Forum, 
<http://www.voicexml.org/>, is extended for use by the execution engine 202 in the voice 
portal 110. 

Additionally, the execution engine 202 may access the data connectivity engine 220 
for access to databases and web sites (e.g. the shared database 1 12, the web site 230), the 
evaluation engine 222 for computing tasks and the streaming engine 224 for presentation of 
streaming media and audio. The streaming engine 224 may allow users of the voice portal 110 
to access streaming audio content, or the audio portion of streaming video content, over the 
telephone interface. For example, a streaming media broadcast from ZDNet™ could be 
accessed by the streaming engine 224 for playback through the voice portal. 

The data connectivity engine 220 supports access to a variety of databases including 
databases accessed across the Internet 106, e.g. the database 228, and also access to web sites 
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over the Internet such as the web site 230. In some embodiments the data connectivity engine 
can access standard query language (SQL) databases, open database connectivity databases 
(ODBC), and/or other types of databases. The shared database 1 12 is represented separately 
from the other databases in Figure 2; however, the shared database 1 12 may in fact be part of 
5 one of the other databases, e.g. the database 226. Thus, the shared database 1 12 is 

distinguished from other databases accessed by the voice portal 1 10 in that it contains user 
profile information. 

Having described the hardware and software architecture supporting various 
embodiments of the invention, the various personalization features provided by different 
10 embodiments of the invention will now be described. 

it 

! *0 D. Telephone Driven Profile Building 

P Turning to Figure 3, the process of creating a profile using a telephone interface will 

;|L be described. This process will be described with reference to the call flow arrows shown on 
J I Figure 1 as well. 

15 The voice portal 1 10 is able to flexibly handle multiple callers from a single telephone, 

e.g. Tom and Dick are roommates and both call from 650-493-####. Similarly, the voice 
portal 1 10 is able to handle a single caller that uses multiple telephones, e.g. Tom has a cell 
phone 650-245-####, his home phone 650-493-####, and a work phone 408-301-####. The 
manner in which the voice portal 1 10 can handle some of the above situations will be 
20 discussed throughout. In the example used while describing Figure 3, the process will be 

described using a caller Jane Smith as an exemplary caller who has never registered with the 
voice portal 110 from any telephone and an exemplary caller John Doe who has previously 
called the voice portal 110 from his telephone 100. 
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First, at step 300, telephone identifying information is received. This is shown in 
Figure 1 by call flow arrow 1 14 representing the transfer of telephone identifying information 
through the telephone gateway 107 to the voice portal 110. This step occurs after a user has 
placed a call to the voice portal 110 with a telephone, e.g. the telephone 100. 

Next, at step 302, a determination is made as to whether the telephone identifying 
information corresponds to a known profile, e.g. is the user registered? Some examples may 
be illustrative. If Jane Smith uses the cellular telephone 101 to call the voice portal 1 10 for the 
first time, her telephone identifying information will not be associated with any existing 
unique profile in the shared database 1 12. Therefore, at step 302, the determination would be 
made that she is not registered and the process would continue at step 304. In contrast, John 
Doe has previously called the voice portal from the telephone 100 and so his telephone 
identifying information will be associated with a profile in the shared database 112 and the 
process would continue at step 306. 

If, the telephone identifying information is not associated with an existing profile in 
the shared database 1 12, a new profile is created at step 304. The new profile may be 
initialized using a variety of information derived from the telephone identifying information 
and/or predetermined values for the voice portal 110. Thus, for example, when Jane Smith 
calls for the first time from the cellular telephone 101, an initial profile can be created using 
the calling number, e.g. 650-493-####, included in the telephone identifying information to 
select initial profile settings. The call flow arrow 116 shows this process on Figure 1. The use 
of the telephone identifying information to create an initial profile is discussed below in the 
section "Automatic Profile Initialization". 
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In some embodiments, the profile is not initialized using the telephone identifying 
information. In other embodiments, the user may be explicitly queried by the voice portal 1 10 
to create one or more components of the initial profile, e.g. "Please speak your first name", to 
allow for more personalized prompting by the voice portal 110. Once a profile is created, the 
5 process continues at step 306. 

At step 306, the profile is retrieved from the shared database 1 12 as shown by the call 
flow arrow 118. The profile can be updated throughout the call based on the user's behavior 
and actions ~ implicit preferences - as well as explicit requests from the user to customize 
the voice portal 110. Once a profile is selected at step 306, the personalized content can be 
i£! 10 presented to the user as shown by the call flow arrow 122 in Figure 1 . 

"tr 5 

i% i For example, John Doe, who is calling from the telephone 100, already has a profile in 

l fi the shared database 112. That profile may indicate that John prefers a southern dialect and 
^ likes to hear a quick stock market report immediately on call in. Thus, for John, his telephone 
iff! identifying information serves to log him directly into the system and trigger the personalized 
|p 15 behavior unique to him: a quick stock market report in a southern dialect. In contrast, a 
S3 different caller, Sarah Brown, from a different telephone will be provided different 

personalized content based on that telephone identifying information. 

The voice portal may support multiple callers from a single telephone. For example, 

Sarah Brown and John Doe may both use the telephone 1 00 to call the voice portal 1 10. In the 
20 case where two or more profiles are identified with the same telephone identifying 

information, the voice portal may prompt for a password or other unique identifier, either as 

voice or touch-tone, to select among the profiles. 
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However, as a general matter, the voice portal is configured to minimize the need for a 
caller to provide a password. Thus, during a single call session, the caller is typically only 
asked to provide her/his password a single time. However, some embodiments of the 
invention may require that a password always be used to complete commercial transactions 
5 and/or after the passage of a predetermined period, e.g. ten minutes since last password 
prompt. In some embodiments, the user may adjust her/his profile to allow login without a 
password for playback features. 

Also, a single profile can be associated with multiple calling numbers. For example, 
the user Jane Doe could specify that both the telephone 100 and the cellular telephone 101 
2 10 should be associated with her profile. Similarly, if Jane calls from a new telephone, e.g. pay 
t% i phone, she can provide her existing telephone number and her password to access her profile. 
5 In some embodiments, whenever the user calls from a new telephone number, she/he is 

m prompted as to whether to remember the number for future use. In some embodiments, 
m additional telephone identifying information, e.g. this is a pay phone, is used so that the caller 
in 15 is not prompted to associated telephone numbers that are likely to be single time uses with 
Q her/his profile. Similarly, voice verification may be used to recognize a caller's voice instead 

of, or in addition to, using a password or other identification number. 

Typical events that would require a password, or that the user be authenticated 
previously with a password, might include adding and removing items from the user profile 
20 through explicit commands as well as requests for specific personal information, e.g. that 
user's stock portfolio, bank account balances, etc. 

It is not necessary for callers to the voice portal 1 10 to explicitly specify their 
preferences using this embodiment of the invention. The callers' behaviors and actions are 
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used by the voice portal 1 10 to adopt implicit preferences, sometimes after receiving 
confirmation. For example, behaviors and actions reflecting repeated access to a content in a 
particular topic, or a particular topic, may cause the voice portal 1 10 to automatically include 
the repeatedly requested content in the default message. 

For example, if a caller from New York City repeatedly asks for the weather in San 
Francisco, the system can add the San Francisco weather to the standard weather report. 
Alternatively, the system may request confirmation before adding the weather report, e.g. 
"Would you like me to include San Francisco in the standard weather report?" Similarly, at 
the level of topics, users who repeatedly ask for information about business related issues may 
find that the system will adjust the main menu to include business. Similarly, if that same user 
never asks for sports scores, that option may drop off the main menu. In some embodiments, 
the system may ask for confirmation before modifying the menu choices, or the system may 
notify the user of a modification and/or allow a user to review/change past modifications. As 
a result, the structure and content of the call may change, e.g. San Francisco weather will be 
announced at the beginning of future calls and sports information may be omitted. 

Through the use of this process, the need for a specialized editing mode of the type 
seen on customizable web portals is reduced. The user's actions and behaviors shape the 
options presented to her/him. Thus, reducing the need to explicitly pick topics and/or content 
in an editing mode. However, some embodiments of the invention may allow for explicit 
profile creation in an editing mode over the web, see below, and/or over the telephone. Also, 
users are typically permitted to add and remove topics and/or items at will with explicit 
commands, e.g. "Remember this", "Remove", "Add to my stock list", etc. 
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E. Web Driven Profile Building 

Turning to Figure 4, the process of modifying a profile for use over a telephone 
interface over the web will be described. This process will be described with reference to the 
call flow arrows shown on Figure 1 as well. 
5 The process shown in Figure 4 assumes that a profile has already been created, e.g. by 

calling for the first time as described above. However, in some embodiments of the invention, 
users may create profiles using the web interface by providing the telephone identifying 
information for their primary calling phone number and a password. As is the case with the 
telephone registration process described in step 304, the telephone identifying information 
3 1 0 provided, here the primary calling phone number, can be used to create the initial profile. 
H Starting at step 400, the profile is accessed using a computer (e.g. the computer 102) 

'§ via a web interface. The web interface is provided by a web server (e.g. the web server 108) 

Hi— 

W and allows for access to the shared database 1 12 as shown by the call flow arrow 120. 

y . Once the user has signed in to access her/his profile on the computer, she/he can 

m 

il 1 5 manually identify content and topics to build her/his profile at step 404. This can be supported 
6 by allowing the user to specify topics from a list of topics and then specifying per topic 

content from a list of content. For example, the topics might include business, sports, news, 
entertainment, and weather, to name a few. The user could include weather, news, and 
business in her/his main menu and then further customize the specific content to be presented 
20 within those topics. For example, within weather, the user might select the specific cities 
she/he wants listed in her/his weather menu and/or the cities for which the weather is 
automatically played. 
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Alternatively, at step 402, the user can identify a web location with personalized 
content to use in building her/his profile, e.g. a uniform resource indicator (URI). For 
example, Figure 1 includes the personalized site 130. The personalized site 130 could be a 
customized portal web page, e.g. myYahoo!, My Netscape, etc., a home page the user 
5 herself/himself has designed, and/or any other web page that includes content of interest to the 
user. The user can identify the personalized site with a uniform resource indicator (URI), 
including a login identifier and password if necessary, e.g. for myYahoo! The personalized 
site 130 can then be accessed and the pertinent user preferences, e.g. news, stocks, selected. 
Taking the example of a customized portal site, the main topics selected, e.g. horoscopes, and 
*5 10 the content within, Sagittarius, could be adopted. However, the voice portal 110 may present 

its own content for that particular item, e.g. the version of the Sagittarius horoscope on the 
IjK voice portal 1 10 not the version from the personalized site 130. 

The processes of step 402 and step 404 can be used together allowing a user to quickly 

O 

ji transfer preferences from a web portal to her/his voice portal while still supporting explicit 
V* 15 personalization. 

O Alternatively, in some embodiments of the invention, an existing web portal profile is 

voice enabled for use by a voice portal through the association of telephone identifying 
information with the existing web portal. In this embodiment, at step 402, the telephone 
identifying information, e.g. the primary calling number, is associated with an existing web 
20 profile, e.g. myYahoo! profile, stored in the shared database 1 12 and that existing web profile 
is then usable from the voice portal 110 either using voice or touch-tone commands. 
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Additionally, web sites like the personalized site 130 may be accessed using the voice 
portal 1 10 in some embodiments of the invention through the use of the data connectivity 
engine 220 as shown in Figure 2. 

F. Profile Building Via Other Web Sites 

Some embodiments of the invention may allow users of the voice portal 1 10 to add to 
their profile from other web sites. For example, if a user of the computer 102 is accessing a 
web site (e.g. the personalized site 130), the web site might include a link like "Add this to 
your voice portal." Thus, for example, from a service such as MapQuest™ or Ameritrade™, 
the user could click on a link to add a particular piece of content or a particular topic to then- 
portal for the voice portal 110. 

For example, a user could add her/his "QQQ" stock symbol to her/his profile on the 
voice portal 110 even though the voice portal 110 may be operated independently of the 
particular web site. 

This type of web based profile building allows for widespread profile building for the 
voice portal 110 from a variety of Internet sites. Also, in some embodiments, the web browser 
software on the user's computer (e.g. the computer 102) can support an option to add a 
bookmark to the user's profile stored in the shared database 1 12 for the voice portal 110. For 
example, a menu option in the browser on the computer 102 might include "Add Page to 
Voice Portal Shortcuts" and upon selecting that menu option, the current web page would be 
added to the user's profile on the voice portal 110. 

This would typically be accomplished by accessing a URI on the web server 108 that 
included the information to be added. At that point, the web server 108 might ask for a 
primary calling phone number and/or a password. In some embodiments, a cookie stored by 
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the browser on the computer 102 may be used to obviate one or both of these steps. After the 
user provides the information, or it is accepted automatically, a confirmation page may be 
shown including a return link to the originating web page. Several example URTs for adding 
content are shown below: 



<http://www.voiceportal.com/add.cgi?topic=stock%20quote&content= : =QQQ> 

<http://www.voiceportal.com/add.cgi7sho 

ml> 

<http://www.voiceportal.com/add.cgi?sh^ 

ogin=3doe> 



10 These examples are illustrative of the various types of URTs that can be placed as links on 
web sites to allow users of the voice portal 1 10 to further customize their profile. 



G. Locale Based Personalization 

Turning to Figure 5, the basic personalization framework used by several 

If! 

Jp embodiments of the invention is presented. At step 500 ? a request is made for content, or a 

p 1 5 topic. Then one or more of steps 502-5 10 take place, in parallel or sequence, and then the 
FU content is presented at step 512. Which of steps 502-510 occur for a given request maybe 

S determined based on the topic or content requested. For example, step 504 can be omitted 

when non-time dependent information is presented. 

Turning to step 502, the customization of content based on the calling locale. The 
20 telephone identifying information includes information about the caller's locale independent 
of any user provided registration information. This information can be derived from telephone 
routing tables that provide a descriptive name for each area code/exchange combination 
within the North American Numbering Plan (NANP). Thus, the phone number 650-493-#### 
would be associated with "Palo Alto, California". Similarly, 650-592~#### would be 
25 associated with "San Carlos, California". 
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This information maybe directly present in the telephone identifying information 
provided to the voice portal 1 10, or may be ascertained from a local exchange routing guide 
(LERG). For international callers outside the NANP, similar types of telephone identifying 
information can be mapped to locales within countries to the extent permitted by the 
5 particular numbering plan. 

The city-state combination may correspond to multiple locales for the purposes of the 
voice portal 1 1 0. For example, a county-wide or multi-city locale can be defined that 
encompasses multiple area code/exchange combinations. Thus, a single caller maybe in 
multiple locales. 

@ 10 Locale information can be further refined through the use of additional databases, e.g. 

city/state to zip code databases, street address to five digit zip code databases, reverse lookup 
jjl databases that map phone numbers to street addresses, longitude-latitude conversion 

databases, and/or other databases that provide locale related information from telephone 
If! identifying information. Thus, for example, V and H coordinates might be determined using 

IP 15 the telephone identifying information. Those can be further converted to a longitude and 
w latitude to determine the locale. Alternatively, a reverse phone number database could be used 

to find a specific street address for the telephone identifying information. 

Examples of the uses for the locale information include: providing locale-appropriate 

lottery results, providing driving directions to a requested destination, providing 
20 locale-appropriate weather reports, providing locale-appropriate show times for movies other 

events, e.g. cultural, governmental, etc., traffic reports, yellow page listings, and/or providing 

other locale-related information. 
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H. Time/Date Based Personalization 

Turning to step 504, the customization of content based on the time and/or date will 
now be described. The telephone identifying information includes information about the 
caller's locale independent of any user provided registration information. This information can 
5 be derived from telephone routing tables that provide a descriptive name for each area 

code/exchange combination within the NANP. Thus, the phone number 650-493-#### would 
be associated with "Palo Alto, California" and thus the correct time zone, Pacific, could be 
selected as well. 

This time zone may be directly present in the telephone identifying information 
41 io provided to the voice portal 1 1 0, or may be ascertained from the LERG. For international 
2 callers outside the NANP, similar types of telephone identifying information can be mapped 
^ to locales within countries to the extent permitted by the particular numbering plan. Thus, 

is callers from United Kingdom numbers would be mapped to British Standard Time. 

111 The time zone information allows the voice portal 1 10 to customize the presentation of 

ff * 1 5 information based on the time in the caller's locale. Callers can use a single nationwide, or 
^ international, number to reach the voice portal 110, e.g. 800-###-####. The voice portal 110 

will use the time zone information to adjust the content presented to each user. 

Thus, during the lunch hour, the voice portal 110 might report a stock quote to the user 
while on a Friday evening, the voice portal 110 might suggest a movie. For example, "It is 
20 Friday night, would you be interested in seeing a movie?" A "yes" response by the caller will 
lead to the presentation of a list that is both time and date adapted and locale appropriate. For 
example, a caller from Palo Alto at six o'clock p.m. on a Friday would hear about show times 
after six o'clock p.m. in his local area. 
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If necessary, the voice portal 1 10 may connect the user to an appropriate transaction 
system to complete a user requested transaction such a the purchase of an airline ticket, a 
movie ticket, an audio CD, etc. However, in many instances, the voice portal 110 may be able 
to directly complete the transaction using the data connectivity engine 220 and access to the 
5 Internet 106 and/or one more databases (e.g. the database 226). This process can occur even if 
the caller has not explicitly provided the voice portal 110 her/his home location or the current 
time. For example, this personalized content might be presented immediately at after step 304 
of Figure 3 in step 306. 

Similarly, other time sensitive information can be presented such as airline schedules, 
J*5 10 cultural and other events, etc. Thus, for example a caller asking for flight times to New York 
J from a 650-493-#### telephone number might be prompted to select one of the three local 
P airports: San Francisco International, San Jose International, and Oakland International, and 

iff 

J then the flight times to New York after the current time in the Pacific time zone would be 

|f| presented. 

IP 15 Some additional examples include customizing the presentation of business reports 

w based on whether or not the market is open; modifying the greeting prompt based on the time 

of day; and providing traffic information automatically during commute hours, but not at 

other times. 

I. Targeted Advertising 
20 Embodiments of the invention support the presentation of targeted advertising, or 

other content, to callers of the voice portal 1 10 as shown at step 508. The two primary types 
of targeted advertising supported by embodiments of the invention will be described. The 
different types of targeted advertising can be combined as well. 
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1 . Based Solely on Telephone Identifying Information 

Telephone identifying information can be used to reference demographic information 
about callers from a particular area. For example, if the telephone identifying information 
includes the calling number 650-493-####, corresponding to Palo Alto, California, general 
5 demographic information about callers from that particular region can be used to target the 
advertising, or other content. Further, if a reverse lookup database is used, the phone number 
can, in some instances, locate specific demographic information for a given household, or 
caller. 

This personalization allows the targeting of advertising to qualified callers by the 

O 

2 10 voice portal 1 12. For example, an advertiser of expensive luxury vehicles might request that 

-a 

H its callers be qualified based on their income, or a particular psychographic attribute, e.g. fun- 

;5 loving. In that case, the demographic profile corresponding to the telephone identifying 

W 1 information can be used to qualify the caller. Thus, callers from the relatively affluent city of 

li Palo Alto, California might receive the advertising. Similarly, if a particular household meets 

ISM'; = ! . 

il 15 the requirements based on a reverse lookup, those households can receive the advertising as 
O well. 

2. Based on Profile 

Another source of information about the caller is the profile used by the shared 
database 1 12. This profile may indicate interests based on the explicit and implicit 
20 preferences, e.g. likes sports, and can be used in combination with the telephone identifying 
information to more closely tailor ads to the caller. 

For example, if the caller has added movie and entertainment information to her/his 
profile, either explicitly or implicitly, advertising related to movies and entertainment could 



C \Usr\Patents\TMOO-002US\TMOO-002US spec DOC 



35 



Attorney Docket Number TM0O-002US 



be favored over other qualified advertising based on the caller's profile. Other examples 
include providing brokerage, and other financial services, advertisements to callers who 
frequently check stock quotes and/or have a customized stock list. 

J. Adaptive Voice Character 
5 Turning to step 508, the customization of content through adaptive voice character 

will now be described. The telephone identifying information includes information about the 
caller's locale independent of any user provided registration information. The locales may be 
associated with one or more standard voice character settings, e.g. for dialect, and also 
idiomatic speech. Thus, callers from California may receive different prompts and a different 

10 dialect from the voice portal then callers from Florida. 

Similarly, the telephone identifying information may include information about the 
type of phone, e.g. pay phone, hospital phone, etc., that can be used to adjust the voice 
character, e.g. louder and slower speech. 

Additionally, the caller's speaking voice may be used to refine the voice character of 

15 the system. Thus, callers with speech patterns from a particular region of the country may find 
that after several verbal interactions with the voice portal, the content being presented at step 
5 12 is being spoken using a voice character more suited to their own speech patterns. 
Similarly, in response to callers who request that information be repeated several times, the 
voice character for those callers may be slowed and played back louder. Additional examples 

20 include allowing users to select different voice actors, different background music and/or 
sound effects, control the verbosity of prompts, etc. 
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K. Purchase Recommendations 

Turning to step 510, the customization of content through purchase suggestions. Based 
on the caller's profile — as retrieved through the telephone identifying information — and/or 
demographic information from other sources, e.g. locale based and/or reverse lookup, the 
5 system can make purchasing suggestions. 

The suggestions could be based on the caller's locale and what others in that locale 
have purchased. In other embodiments, the suggestions maybe based on the profile of the 
user relative to other user's purchases. In some embodiments, approaches such as 
collaborative filtering are used to generate recommendations. 
10 Examples of recommendations may include particular goods and services, e.g. flowers 

2 for Mom a few days before Mother's Day. Further, the exact suggestion may vary based on 
Jf the caller's past habits, e.g. in the past you bought chocolates so this year chocolates might be 

~ ~ suggested again. Alternatively, if many people from your locale are buying a particular book 

|ff that might be suggested as well. The particular purchase recommendation may relate to goods 

III 

IP 15 and services offered independently, by, and/or in affiliation with the operator of the voice 
© portal 110. 

L. Voice Login 

As discussed above, the system may support the use of one or more passwords, either 
spoken or touch-tone for login and authentication purposes. The passwords provide for 
20 protection against modifications to a user's profile without authentication. Additionally, 
certain specific actions, e.g. making a purchase, listening to certain types of personalized 
content, etc., may require authentication. 
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Typically, the authentication system will support either a voice or a touch-tone 
password for users of the voice portal 110. This flexibility addresses situations where the 
voice password is not working due to line conditions and/or conditions of the calling 
telephone. Products such as Nuance Verifier™ and/or other voice login and verification 
products may be used to provide the voice login feature. In some embodiments, both types of 
authentication may be required. 

Once logged in, or authenticated, embodiments of the invention may minimize the 
need for the user to re-authenticate herself/himself, as described above. Additionally, the 
password, either voice and/or touch-tone, used for authentication for telephone sessions may 
be the same or different as any passwords used for authentication for web access to the profile 
customization options described in conjunction with Figure 4. 

M. Automatic Profile Initialization 

As discussed in conjunction with Figure 3, it may be desirable to initialize the profile 
using the telephone identifying information. The telephone identifying information can be 
used to select an appropriate demographic profile and list of topics based on the calling locale. 
In other embodiments, a reverse lookup of the calling number provided with the telephone 
identifying information is used to obtain a specific demographic profile for a caller and/or 
her/his household. 

Then the demographic information derived from the locale and/or the reverse lookup 
are used to set initial profile values. For example, the user's income might be estimated based 
on the average income for the calling locale, e.g. Palo Alto, California, or from demographic 
information from the reverse lookup. Similarly, the caller's initial topics might be selected 
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based on commonly selected topics for her/his locale and/or the preferences available based 
on the demographic information retrieved by the reverse lookup. 

These initial values maybe revised based on a caller's later actions. For example, if 
the initial estimate of a caller's age is too high, later actions may cause that information to be 
5 revised. Similarly, callers may be permitted to explicitly provide certain types of demographic 
information as needed. For example, the user might provide her/his birth date to a horoscope 
feature provided by the voice portal 1 10, in that instance, the birth date might be incorporated 
into the profile. 

N. Personalized Phonebook 

10 Voice portal 110 can be used to create, manipulate, and update a distinct "phonebook" 

database for each caller or caller profile in shared database 112, where the phonebook can 
include, among other things, names, telephone numbers, and other data of relevance to the 
particular caller. Preferably, the phonebook should be implemented to support data formats 
such as "vCards." The vCard specification was developed by the versit consortium founded 

15 by Apple, AT&T, IBM, and Siemens, which turned the specification over to an industry 

group, the Internet Mail Consortium (IMC) in 1996. The vCard specification makes use of the 
"person" object defined by the CCITT X.500 Series Recommendation for Directory Services 
and can be considered an extension of it. A vCard contains a name, address information, date 
and time, and optionally photographs, company logos, sound clips, and geo-positioning 

20 information. 

The phonebook may be stored as an integral part of each caller's user profile or as a 
separate database associated with the caller's user profile. Preferably, the user profile and 
phonebook should be stored on shared database 1 12 so that it may be updated using a variety 
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of other devices capable of interacting with the shared database through the internet, for 
example computer 102. 

Voice portal 110 also facilitates the implementation of a user friendly mechanism that 
enables a first registered user (i.e., a "sender") to permit others (i.e, the "recipient(s)") to 
5 update their phonebooks with the sender's contact information by performing a simple action, 
such as a mouse click. To make use of this facility, the sender merely includes an appropriate 
link (i.e., a Uniform Resource Locator ("URL"), a type of URI) in emails sent to the 
recipients (e.g., included as part of the sender's .signature file) or alternatively by including 
the link (or a clickable button that sends an HTTP request equivalent to a click on the link) on 
10 a website. An example of such a link or URL is 

http ://www, acmexom/phonebook/addent^userid^O 12381 765 . In this example, the URL is 
J; set to reference a web application "addentry" for updating the phonebook information stored 

* "' in shared database 112. The link should also specify a URL parameter that can be used to 
|ifl uniquely identify the sender's profile, and in this example the parameter is the sender's user- 
fil 15 ID, as registered with voice portal 110. When the recipient clicks the provided link, an HTTP 
G request is sent to the web site server to invoke the web application, which in turn uses the 
cookie facilities of the web site and the client browser combination to determine if the 
recipient has an extant profile and/or phonebook entry that can be identified based upon 
cookies stored on the recipient's computer. 
20 A cookie is data that is stored on an end user's computer at the request of an accessed 

web site so that the site can, among other things, identify the user on each subsequent access 
request to the site or even on subsequent visits to the site. A stored cookie is sent along with 
each http request made by the user to the site that stored the cookie for so long as the cookie is 
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valid. Cookies may be maintained on a session or persistent basis. Session cookies are no 
longer valid after the user exits the browser program, whereas persistent cookies may be 
maintained for an arbitrarily long period of time. Persistent cookies can therefore be used by 
a web site to associate information stored at the site to a particular user across multiple 
sessions. 

In the present example, if the recipient's profile and/or phonebook can be identified 
from a received cookie, then the application uses the user-ID parameter specified in the URL 
to access selected information from the sender's profile and enters that information into the 
recipient's profile and/or phonebook in shared database 1 12. If the application cannot match 
the cookies received from the recipient to an existing profile and/or phonebook or if the 
application does not receive any relevant cookies, then the application can prompt the 
recipient to login or otherwise present authenticating information in order to update an extant 
profile and/or phonebook entry in shared database 112. Alternatively, the application can 
interactively create a new profile and/or phonebook entry for the recipient and then 
automatically populate it with selected information from the sender's profile in the manner 
previously described. 

O. Messaging 

In another embodiment of the invention, the voice portal 110 can be configured to 
store and forward messages recorded by a caller. In this application, the voice portal can also 
be considered to be an interactive voice response ('TVR") system, which is an industry term 
of art for an interactive system that is capable of receiving input via voice and keypad and 
which is capable of audio and other response modes. For simplification, the following 
examples assume a caller who has previously registered using voice portal 110 and therefore 
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has an existing user profile in the shared database 1 12. After the callers dials the telephone 
number to access the voice portal 1 10, the caller's telephone identifying information (e.g., 
AM) is received by the portal, which can then be used to obtain the specific caller's profile 
using any of the methods described herein. 

The caller may selectively launch the message forwarding application of voice portal 
1 10 through a spoken command or through telephone keypad inputs, e.g., DTMF tones. The 
execution engine 202 switches the voice portal 1 10 into recording mode and the voice portal 
110 then records a message from the caller in database 226. Voice portal 110 terminates the 
message recording process when it receives an escape keyword or keypad input from the 
caller, or alternatively, upon the expiry of a predetermined timeout period during which no 
further meaningful audio input has been received. The voice portal 1 10 can prompt the user 
for the message destination(s) and the caller can then instruct the voice portal 1 10 to forward 
the message to other registered users on the system by speaking their respective names (or 
other identifier that is associated with a target destination's entry in the caller's phonebook), 
by identifying the target destinations via DTMF sequences corresponding to the target 
destinations' name, or by entering a phone number that the voice portal 1 1 0 knows is mapped 
to a registered user. The destination input step can optionally be sequenced to occur prior to 
the message recording step. When the other registered users subsequently call in, the voice 
portal 110 notifies the respective users that they have a message waiting and prompts them to 
determine if they wish to play the recorded message or otherwise dispose of the message. 

In an alternative embodiment, following (or prior to) the recording of the message, the 
voice portal 1 10 can prompt the caller for one or more destination numbers, which may 
entered directly or indirectly by speaking a name (if a corresponding entry exists in the 
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phonebook), speaking a phone number sequence, or by using the telephone keypad to enter 
the numeric sequence directly. In this embodiment, the messages need not be directed to 
registered users of the voice portal 1 10. When a destination name or phone number input 
does not match any phonebook entry, the system can query the caller to determine if the caller 
wishes the system to remember the name and number and to update the caller's phonebook 
accordingly. After completion of destination inputs and phonebook updates, the voice portal 
dials the destination phone numbers and if the phone is answered, the voice portal can either 
play the message or prompt the call recipient with a query to determine if the recipient wishes 
to hear or otherwise dispose of the message. The actual message delivery by the voice portal 
can be handled asynchronously from the caller's interactive session with voice portal 1 10, so 
the caller can continue to access other information or terminate the call after having recorded 
the message and identifying the list of recipients. In an alternative embodiment, if additional 
telephone lines are available to the voice portal 1 10, it can initiate message delivery in one or 
more separate threads of execution at any time after message recording and destination input 
have been completed. The voice portal may be further programmed to recognize when a 
message delivery call made by it is answered by an answering machine, and in that case, the 
voice portal 1 10 can simply play the entire message into the answering machine or leave a 
concise statement indicating that the recipient has a message waiting from the caller, instead 
of prompting for message disposition. 

For any of the described embodiments, the voice portal can optionally be configured 
to add additional audio content to the beginning or end of the recorded message (or to any 
related notice or prompt directed to the intended recipient in connection with the recorded 
message), which feature can be used, for example, to promote products, services, or brands. 
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Preferably, the appended audio content should be relatively brief so as not to be intrusive to 
recipients. The appended content can be varied (i.e., rotated) and can also be selected (i.e., 
targeted to the recipient) based upon the recipient information contained in the recipient's 
phonebook, vCard entry, or profile (if the recipient is also a registered user of the voice 
portal), for example. More generally, any audio content suitable for telephone playback can 
be appended to the recorded message, including caller selected or caller customized content, 
e.g., sound effects, jokes, musical fragments, and the like. 

The described messaging function can support a number of different revenue models. 
For example, an operator of a voice portal 1 10 can sell advertising time for placement of 
sound ads embedded in the delivered messages. Such ads can be fixed, varied, or customized 
based upon known attributes of the recipient. Alternatively, the messaging service can be 
provided on a fee basis and the placed messages can incorporate concise advertisements or 
brand identifier to promote the service. 

P. Call Placement and Conferencing 

Voice portal 1 10 is capable of interacting through a plurality of independent ports with 
telephone gateway 107, hence voice portal 1 10 can entertain multiple concurrent inbound and 
outbound calls, typically one per port. Accordingly, the voice portal may be configured to 
perform call placement for users, which may also be referred to as call "tromboning." In one 
embodiment, the user can simply speak a name or enter an associated DTMF sequence, and 
the voice portal can look up the relevant phone number from the user's phonebook. 
Alternatively, the user can speak or enter a telephone number, and if there is no corresponding 
phonebook entry, the voice portal can prompt the user to update the phonebook, if desired. In 
either case, the voice portal 1 10 then connects the user to the appropriate other number. This 
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type of call tromboning will occupy two ports, one for the direct connection with the user and 
a second port to make the outbound call to the other number. Once the second call has been 
terminated by the recipient, the initial caller, i.e., the user, may continue to interact with voice 
portal 1 10 in the usual mode. 

This call tromboning capability may also be employed to effect multiple outbound 
calls, provided that sufficient ports are available, which permits the voice portal 1 10 to 
operate as a telephone conferencing system. Phone number entry is substantially the same as 
described in connection with the call placement functionality, except that the user can enter or 
be prompted to enter multiple call destinations. The voice portal can then dial the destination 
numbers and conference them together. 

In both the call placement and call conferencing embodiments, voice portal 1 10 be 
configured to obtain and store information for billing the user, if appropriate, by accessing 
data stored in the user's profile or by interactively obtaining the user's credit card number, 
calling card number, personal identification number ("PIN"), or the like. The call placement 
and call conferencing functions can optionally be configured to add brief marketing or 
advertising material to be played to the user, the called parties, or both. 

Q. Conclusion 

Thus, a voice portal for presenting personalized content over a telephone interface has 
been described. The information provided over the voice portal may come from the World 
Wide Web (WWW), databases, third parties, and/or other sources. Telephone identifying 
information is used by embodiments of the invention to personalize caller interactions with 
the voice portal. This allows the system to present highly customized information to each 
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caller based on a personal profile the system associates with the telephone identifying 
information. 

A number of different personalization features provided by embodiments of the 
invention have been described, those features can be combined in a number of ways to 
provide personalized content. 

The foregoing description of various embodiments of the invention has been presented 
for purposes of illustration and description. It is not intended to limit the invention to the 
precise forms disclosed. Many modifications and equivalent arrangements will be apparent. 
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What is claimed is: 



CLAIMS 



1 1 . A method of updating a user profile implemented by a computer-based interactive 

2 voice response system, said method comprising: 

3 (a) receiving an incoming call from a caller; 

4 (b) retrieving a telephone identifying information from the incoming call; 

5 (c) using the telephone identifying information to access the user profile, the user 

6 profile corresponding to the telephone identifying information; 

7 (d) prompting the caller for a target telephone destination; 
p 8 (e) receiving the target telephone destination; 

; J 9 (0 determining a target telephone number corresponding to the target telephone 

lis i 

%4 10 destination; 

5 1 1 fe) P rom Pting the caller with an option to enter the target telephone number in the user 

m 12 profile when the target telephone number does not correspond to an extant telephone 

~ 13 number entry in the user profile; and 

Jg 14 (h) in response to selection of the option by the caller, prompting the caller to input an 

|| 1 5 identifier with which to access the target telephone number, receiving the identifier, 

g 16 and storing the target telephone number and the identifier in the user profile. 

1 2. The method of Claim 1 wherein the telephone identifying information is an AM 

2 associated with the incoming call. 



1 



3 . The method of Claim 1 or 2, comprising the further step of calling the target telephone 



2 number. 

1 4. The method of Claim 1 or 2, wherein the target telephone destination is a spoken 

2 name. 
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1 5. The method of Claim 1 or 2, wherein the target telephone destination is a spoken 

2 number sequence. 

1 6. The method of Claim 1 or 2, wherein the target telephone destination is a DTMF 

2 sequence. 

1 7. The method of Claim 1 or 2, wherein the identifier is a spoken name. 

1 8. The method of Claim 1 or 2, wherein the identifier is a spoken number sequence. 

1 9 The method of Claim 1 or 2, wherein the identifier is a DTMF sequence. 

ft 1 10. In a world wide web connected computer system, a method of adding to a first user 

% 2 profile corresponding to a first user a data set retrieved from a second user profile 

111 3 corresponding to a second user in response to a single HTTP request made by the first user, 

$ 

O 4 the HTTP request corresponding to a URL provided by the second user to the first user and 

W 5 including a second user identifier corresponding to the second user profile, said method 

6 comprising: 



7 (a) receiving the single HTTP request from the first user; 

8 (b) using the second user identifier to selectively retrieve the data set from the second 

9 user profile; 

10 (c) determining if the single HTTP request includes a cookie that is associated with 

1 1 the first user profile; 

12 (d) adding the data set to the first user profile in response to determining that the 

13 single HTTP request includes the cookie that is associated with the first user 

14 profile. 
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1 11. The method of Claim 1 0, wherein the second user identifier is a parameter specified in 

2 the URL. 

1 12. The method of Claim 1 0, wherein the data set comprises a name and a telephone 

2 number. 

1 13. The method of Claim 1 0, wherein the data set is a vCard. 

1 14. The method of Claim 1 0, wherein the telephone identifying information is an ANI. 

1 15. The method of Claim 10, 11, 12, 13, or 14, wherein the second user identifier 

2 comprises a user-ID corresponding to the second user. 

5 1 16. The method of Claim 10, 11, 12, 13, or 14, wherein the second user identifier 

jnfjj 2 comprises a telephone identifying information corresponding to the second user. 
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ABSTRACT 

A method of accessing and updating an electronic phonebook over electronic 
communications networks such as a telephone and computer networks is described. The 
creation of a voice portal is supported by the invention. Embodiments of the invention use 
telephone identifying information such as the calling party's number to identify, or create, 
user profiles for customization. The user profile can include personalized phonebook entries 
that include names and telephone numbers of relevance to the user. Additionally, the voice 
portal can connect the user to numbers contained in the personalized phonebook in response 
to spoken commands. The profile can also be updated with additional phonebook entries over 
the internet using a web browser. 
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Attorney Docket No.: 22379-703 

COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR UTILITY PATENT APPLICATION 

As a below-named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my 

name; 

I believe I am the original, first and sole inventor (if only one name is listed below) or 
an original, first and joint inventor (if plural names are listed below) of the subject matter 
which is claimed and for which a patent is sought on the invention entitled: 

METHOD AND APPARATUS FOR CONTENT PERSONALIZATION 
OVER A TELEPHONE INTERFACE 

the specification of which 

is attached hereto. 



X was filed on 22 October 1999 as Application No. 09/426 A 02 

and was amended on * . 

(If Applicable) 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the examination 
of this application in accordance with Title 37 5 Code of Federal Regulations, § 1.56(a) which 
states in relevant part: "Each individual associated with the filing and prosecution of a patent 
application has a duty of candor and good faith in dealing with the Office, which includes a 
duty to disclose to the Office all information known to that individual to be material to 
patentability as defined in this section... .The duty to disclose all information known to be 
material to patentability is deemed to be satisfied if all information known to be material to 
patentability of any claim issued in a patent was cited by the Office or submitted to the Office 
in the manner prescribed by §§ 1 .97(b)-(d) and 1 .98." 

I hereby claim foreign priority benefits under Title 35, United States Code, §1 19 of 
any foreign application(s) for patent or inventor's certificate as indicated below and have also 
identified below any foreign application for patent or inventors certificate on this invention 
having a filing date before that of the application on which priority is claimed: 

Prior Foreign Application(s) Priority Claimed 



(Number) (Country) (Day/Month/Year Filed) Yes No 
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I hereby claim the benefit under Title 35, United States Code, §120 of any United 
States application(s), and under §1 19(e) of any United States provisional application(s), listed 
below and, insofar as the subject matter of each of the claims of this application is not 
disclosed in the prior United States application in the manner provided by the first paragraph 
of Title 35, United States Code, §1 12, 1 acknowledge the duty to disclose material 
information as defined in Title 37, Code of Federal Regulation, § 1.56(a) which occurred 
between the filing date of the prior application and the national or PCT international filing 
date of this application: 



(Application Serial No.) (Filing Date) (Patented, Pending, Abandoned) 



(Application Serial No.) (Filing Date) (Patented, Pending, Abandoned) 



I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application 
and transact all business in the Patent and Trademark Office connected therewith, and to file, 
prosecute and to transact all business in connection with international applications directed to 
said invention: 



Address all correspondence to: 

Kent R, Richardson 

Wilson Sonsini Goodrich & Rosati 

650 Page Mill Road 

Palo Alto, CA 94304 

Direct all telephone calls to Kent R. Richardson at (650) 493-9300. 



Paul Davis 
John J. Bruckner 
David J. Weitz 
Kent R. Richardson 
U.P. Peter Eng 
Barbara Courtney 
Richard L. Gregory, Jr. 
Van Mahamedi 
Shantanu Basu 
Shaalu Mehra 
Stephen Warhola 
Shirley Chen 
Joel Harris 



29,294 
35,816 
38,362 

39,443 
39,666 
42,442 
42,607 
42,828 
43,318 
44,934 
43,237 
44,608 
44,743 
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I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made 
are punishable by fine or imprisonment, or both, under Title 1 8, United States Code, § 1 001 
and that such willful false statements may jeopardize the validity of the application or any 
patent issued thereon. 



Full name of sole or 
first inventor: 



Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



HadiPartovi ^ , 



\/\7/ZOO° 



United States 



2280 Green Street #104. San Francisco. California 94123 
Same As Above 



Full name of second joint 
inventor, if any:: Roderick Steven Bratfrwaite 



Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 




~Utt% 



United States 



490 Andrews Street. Livermore. California 94550 



Same As Above 



Full name of third joint 
inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 




us Macdonald-Davis. 



1A. 



-t 

United States 



991 The Dalles Avenue. Sunnyvale. California 94087 
Same As Above 
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Full name of fourth joint 
inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 
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United States 



400 Surmont Road. Los Gatos. California 



Same As Above 



Full name of fifth joint 

inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



Braruiga William Porter ^ , 



United States 



840 E. Dana Street. Mountain View. Calfiornia 94041 
Same As Above 



Full name of sixth joint 
inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



John Giannandrea 




Great Britain 



977 Commercial Street. Palo Alto. California 94303 



Same As Above 



Full name of seventh joint 

inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 
Residence: 
Post Office Address: 



j/ll too 




Germany 



150 Dohertv Way. Redwood Citv. California 94061 



Same As Above 
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Full name of eighth joint 
inventor, if any:; 
rnventor*s signature: 
Date: 

Citizenship: 
Residence: 

Post Office Address: 



Anthony Accardi 



^, — 



1945 Mount V ernon Court Apt. 16. 



Mountain View. California 94040 



Stop As Afrpyg 



PuI] name of ninth joint 
inventor, if any:; 
Inventor's signature; 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



-ZhfiJLi 



&JUJ 



.R$ipuWig<7f China 



15 ponoetta Driv e. Apt. 21 1 . Daly Citv T California 9401 5 

J&mc A s A tove., _ _ - — 
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